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The Bilingual Reading Study (descplljed; earlier In" Mace-Matluck's paper) • 
employs various measures to assess the oral language proficiency of the 
Students under Investtgatiqp. The battery includes (1) a standardized oral 
language proficiency test, (2) three sets of teacher ratings, and (3) an 
. ethnographic verification of the children's language abilities based on 
audio tapes collected In three different settings. In this paper, the 
reliability and distribution of responses for each measure wiTl be presented, 
followed by a discussion of the relations among Ihe various measures. Also, 
•comparisons will be made across'time for the 41 cfi.i]dreh on which data from 
two successive years have been obtained. . 

GlobaV Indices of Dominance . • / 

Ope of the?^ primary^variables used in the s'electlon of the target 
children is^gree of bil ingualism, which is^assessed in September by asking 
teachers to classify each of their students on the Student Operational 

Language Assessment Scale - SOLA (Duncan & De Avila, 1976). Table 1 presents 

^ ^ • ' / t ' ^ 

the distributions of ^ratings obtained in September 1979 for the 60 target 

students in District A (a rural and rather isolated school district in the 

Rio Grande Valley of iouth-c'entral Te^as), the 40 children in District B, 

^ and the 20 children in District C (both of the latter being districts Tocatei^v 

some 40 miles from the city of El Paso). For the 41 children from Distri^cj: A 

who were ^^their second year* of~ participation in the Bilingual- tleadinp Study, 

iheir SOLA classifications for the previous year. (September 1978) are also 

given. ' . : ^ 

• In general, the data from September 1979 indicate that the\eachers 

rated all of these students as Spanish speaking: bilingual (Category 1, 

20%)'; partial bilingual , English dominant (Gregory 2,^8%); partial , bilingual 
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SOLA Categories 



1 = Bilingual » 

2 = Partial bilingual , .English do(ninant 

3 = Partial bilingual, Spanish dofninant 

4 « Monolingual English , i 

5 = Monolingual Spanish , • 

6 = Limited English and Spanish 

7 « Late language learner 

o 
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Percentage 
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Spanish dominant (Category 3, 335^)i Spanish monolljigual (Category 5, 30Xj ; 
.andjimfted 'in both Spanish and English (Category 6, 9;^), Note in particular 

4.1 

Vthat none of thesa ctiildren were judged by their teachers to be late language 
learijersv Fur.ther, of the U children classified as limited in.both English 
and Spanish; 8 of these were made by a single-first grade teacher in District 
B, and we suspect that this reflects* the particular teacher's limUed ex- 
perience 'with th^s hew class of children early In the Fall tenn, VatheA than , 
the student's actual oral proficiency. . > 

wThe dlstnibutioni of responses Itself must not be^taken as representative • 
of the students fdCJund in the three districts, ds target students were selected 
to represent certain language respur*ces at the exclusion of others, 

Comparing the subsample of 41 staHer^s in District A, the datav-^ti§gest 
a^tr,end toward greater English proficiency, shown by the Increase in. both 



English a^id Spanish partial bi Unguals coupled with a decrease In the number 
of judged monolingual Spanish speakers; . 

Each district-with a bilingual program is required to administer at ; 
-44east one state-appK^r^c6mmercially-dv^ language test to Its enter- 

, i'ng kinderjgarten students, and these data were collected for each of the 
target students participating in the Bilingual Reading Study; All of the 
d'i^ljrlcts in last yearns cohort. Iiad adopted the Language^Assessilient Scales - 
LAS'lDe Avila & Duncan? 1977), and the data, from both the English and/ 

' ■ ■ ♦ o ' , ' . / 

.Spa'r\ish .version are presented in Table* 2. ' 

V ■ * . ' " ' ■ J ... r . 

Here, levels of proficiency in the two languages are^combined to form 
a measure known as Relative Linguistic Prof icielicy, ^ pro^dure suggested by 
the authors of the test.. This index is exprefS^d, as a ratio of English 
profieiency to Spanish proficiency, such that a 5/5 indicates a fully bilin- 
gual child; 5^ 5/1, a monolingual English-speaking childf a 3/3, a limited 
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.Fraquancy Count: for Urvguagd Aasassmant Senile V^luei-- 
' CQtlvarracI to SOU kal a, Values 



•SOU figinverts of LAS RLP Values , . 
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SOLA correspondences °to LAS RLP. value^; 



1 = bilingual (RLP=5/5, 5/4, 4/5, 4/4), 

2 = Partial bilingual, English dominant • . (RLP'5/3„ 4/3) ' . 

3 « Partial bilingual, Spanish dominant (RLT'=3/5, 3/4^) 

4 =.j1onolin.gual English (RLP=5/1,. 5/2, 4/1, A/p • 

5 = Monolingual Spanish (RLP=l/5i. 2/5, 1/4.' 2/4) 

6 « Limited English and Spanish (RLP=3/3)i, . , 

7 =H.ate language learner tRLP=3/l, 3/2. 2/1, 2/2, 2/3, i/3, 1/2, 4/1) 
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spedjiierQf both languages i an^i a X/l, a late language learner, These 
Indices ye».<tl)iti gcQupad according to th'ebOLA classification system to 
allow a**rouuh comparison of the two measure/. 

The most striking feature of the data from 19/9 concerns the number of 
children classified by the UASjas late language learners, 49%, as compared 

with none so rated by their teachers on the SOLA scalas. 

^ ' " / ' * ' 

• ' Looking at^the LAS data for the subsaniple of 41 target students from 
District A, It, Ilka tho SOLA, ruvoaU.a trmid toward EnyUsh proficiency, 
partlcularVy ovidfcnt for the older children. Note, howaver, that many of 
these students are still classified as late lancjua<je learners by the LAS, 



Teacher Ratings of Communication Skil l! ' 

Teachers rated the target students' proficiency In each language In 
December (for 1979 only) and In April (for both years) using the SEDL Oral 
Language Proficiency Scale - ORRS (Mace-Matluck, .et al., 1979). This rating 
is distinct from the SOLA ratings In that the OPRS ratings Indicate each 
child's overall communication skill In the two languages separately, while 
the SOLA ratings provide a more global language dominance assessment. 
Reliability for the OPRS can be estimated via correlations between the Fall 
and ^Bciii^^Vatings, assuming that the constructs measured ^remain stable 
over this time period. These correlations are presented in Table 3l 

For the English ratings, the correlations range i^rom .76 to .82, 
suggesting a /fairly reliable measure, f'or^the Spanish ratings, ^the correla- 
tions are substantially lo\/er, ranging from .34 to .52. We suspect that 
these values* reflect the restricted range of scores obtained in our sample, 
and thatN^trbnger correlations would obtain with a broader sample. 



f ^ TdbU 3 \ 

Means, KUrKldrtl OevUtlons , imcJ cSrreUtionfi Batween the Fa 1)1 
and SprifUjN^dmln jstrations of thd SEDl, Oral Proficiency Ratlnu Scale 
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' Tdbldi 4 4Hd S iiispUy tha rasults of the OPRS Sprlna rdcirujsi far bath 
Knqllsih dnd SfmnUh, Tha KnyVUh ratlnu^* ror Spriruj ^aao sihow d broad rariyti 
uf 4bnUy with 4ti* of the chlhlien VAitai imtivd ur iicar iiJitjvo In their 
tnuH^h cunttiumlciit iiMi tikllU (laveU 4 rtiul h), and aniy Hi r4tad cis minliMal 
part jcipi^nt^ (levtil I), with thd rt^tiiiitnlny 4ii rnllliig tntorMi«*Hrttc hetwdan 
thtiiiti urtiuiHMUJi (IdvuU and 0- Ihtt tr^and toward u»'«ftter I nullah prort 
ctdivry for olil«r chlhln^n ob^itirvbd In the SOLA daU \^ aUo evUlenced here* 
a*^ (^nly 4 %tinl«iit!j In the tlrnt gratle In l)l^trU:t A hi V)/') were rattjil at 
level?^ 4 iin<t but a ytMr later Itr second grade, 14 ^itoddotti were 
clas% i fled, 

ft 

rho\Spdnish ratintjs for Sprini) 1*1^0 nhow the expected larye percantaije 
of proficiertt Spanish speakers: classified as native or near-native 

ability with none rated as capable of only minimal participation- 

In order to^rovide an ethnographic verification of each child's 
linguistic capability, children's interactions were audio taped In three 
different settings: (1) the classroom (teacher-pupil), (2) the playground 
(peer-pOpil ) , and (3) the home (family-pupil). As described in the earlier 
papers, these tapes were transcribed and'analyzed in a number of ways by 
the SEDL research staff. One analysts was the rating of each child's over-, 
all communication sicill in, each language, us^ng the same scale as was used 
foY' the teacher ratings. The reliability of this assessment is founded 
Qh interrater agreement. Each of three raters independently rated 15 tapes, 
knd high correlations among their ratings, in conjunction with minimal mean 
differences as shown in Table 6,"~T^P[e^e' high interrater reliability. 
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3 » Participates in most conversation; occasional errors in production 
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Table 7 displays, for eac^ type of IjiWVaction, the distributions of. 
ratings by trade level for both EngUii and Spanish, and the results can 
be easily^inniarized. For those ^eakers preferring Spanish, their overall 
communication skill was judged/co be native in almost every ^c^sefC 98% in 
T-P interactions^ 95% in P-p/interactlons, and 94% in F-P. interactions). 
For those spea^kers using-^glish, the idata reveal rauch-more'' variability in. 
communi cation skills, especially in the classroom setting, but still show 
large percentages of native and n^ar-n.ative skill (68% in T-P interactions, 
84% in P-P interactions, and 85%'in F-P interactions). 

Tab1"e 8 presents -the data collected from English taped episodes on the 
subsample of students with two years participation in the study from Dis- 
trict A. Again, they suggest that English proficiency improves during the 
time period. In T-P interactions. in 1978-79, 43% of those using ^English in 
th6 classroom were rated as native or near^native skilled, while after a 
year, 67% were so rated/ In P-P and F-P interactions, the percentages are 
stable across the two years, but the small number of interactions makes for 
a questionable conclusion. 

Table 9 presents the data for the^same set of children, but for the 
tapes' containing sufficient amounts of Spanish to allow a rating to be made. 
Again, the data show that for all children using Spanish in any of the three 
settings, they are judged to be native or near-native skilled. 

I ■ ■ ' 

Comparisong-^nd Correlations Across Measures 

The primary purpose for using the three different approaches to 
language measurement reported above is to accurately and precisely assess 
each child's oral language development. In Table 10 the means and standard 
deviations of each of the measures are presented along with their cross scale 
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Table 8 



Ratings of Students' Overall Communication Skilly in English Based on Audio 
Tapes Collected in Three Different Settings in Each of Two Successive Years 
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Table 9 



Ratings of Students' Overall Communication SIcill in Spanish Based on Audio 
Tapes Collected in Three Different Settings in Each of Two Successive Years 
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3 = Participates in most conversation; occasional errors in production 

4 --Almost native quality 

5 = Native speaker quality , V 



ERIC 
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: Table 10 

'Means, Standard Devi-ations, and Correlations for LAS, OPRSV 
' J and Tape Rating, Measures '• ' ■ 



I 



Measure 
LAS 

OPRS , . • 

Teacher-Pupil Japes 
(T-P) 



ENGLISH ; 
^ Standard, 



Pupil -PupiT Tapes 
(P-P) 

Family-Pupil Tapes 
(F-P) • • V 



N 

116 
116 
66 

49 

40 



Mean 
2.5 

' 3.0 
3.8 

4.3 

4'. 4 



Corre^-ations: 



Deviation LAS 


OPRS 


T-P 


p-p- - 




i.es 


.76* 


.47* 


.50* 


.26 


^1.6t) 




.52* 


.59* 


-:54* 


,^..83 ' ■ 




* 


.42* 


i59* 


1.02 - 






a 


.48* 


0.74 











SPANISH 



Measure 



N * Meafi 



standard ^ 
Dey^atiori LAS 



Correlations: 
OPRS ■ T-P "P-P. 



F.-P 



LAS 


- 116 


3.0' 


1.43 . ' 


.25* -.03 


.07 


.09 


OPRSi 


114 


• 4.5; ' 


' 0.79 * . 


: .".21-^ 


.03 


-.04 


Teacher-Pupil Tapes 
(T-P). 


53 


-5.0 


0. 14 




-.02 


-.03 


Pupil -Rupil Tapes 
(P-P) 


95 


4.9 


0.29 


V 




-.04 


Faniily-PupiT\Tapes 
(F-P) 1 


88 V 


4.9 


0.23 








*Significant at .01 


level . 








s 
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correlation coefficients. The measures of English oral language show ^ 
moderati^ coefficients ranging from .26 to .76, and an examination of the 
means sh6ws that LAS ratings generally, tend to be the lowest, followed by 
OPRS ratings, T-P tape ratings and, P-P and F-P ratings. In Spanish, th^^ 
correlation coefficients for the most part are zero, and an examination of 
the means and standard deviations kgain suggest that this reflects the 
restricted range of values which occur among the sample. 



Summary . - ^ ^ \ ! 

• The data obtained f rW the language measures used in the Bilingual 
Reading Study for the students sampled can be summarized as follows: 



1.. 



2. 



The standardized LAS values tend to underestimate the' relative 
oral' language 'proficiency of those tested when compared against 
teacher ratings using- the SOLA scales. The effect is more pro- 
nounced- in- Spanish than in English, and for ygunger than for older 
studentsv ' , 



Teacher ratings on tffe OPRS ar^ somewhat low^ than those obtatjigd 
on thenape, ratings. . Both hold that the students under investig'a- 
Ltion are proficient speakers of Spanish, ^and both show a trend 
toward greater English proficiency over -time. 
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